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ON LINEAR EQUATIONS WITH AN INFINITE NUMBER OF 

VARIABLES. 

Bt Maximb Bocheb and Louis Brand. 

E. Schmidt's treatment of a system of linear equations with an infinite 
number of variables* is of such essential simplicity and importance that it 
seems destined to become classical. The original memoir, however, owing 
to its condensation and to the rather abstract form which it has in parts is 
not entirely easy reading for the beginner, and Kowalewski's presentation,! 
while attractive in some respects, is extremely long and so arranged that 
unless one reads the whole it is almost impossible to get at the essential 
results. 

The following treatment, which so far as it goes is complete in itself, 
is a modification of those heretofore given. Its characteristic features are, 
on the one hand, that it avoids altogether the process of normaliza- 
tion which plays such an essential and often repeated role in the earlier 
treatments; and, on the other hand, that it deals first with the case of a 
finite number of equations involving an infinite number of variables and 
regards the case of an infinite number of equations as a limit. 

For the sake of clearness, though this is not logically necessary, the 
algebraic case of a finite number of variables is taken up first. 

1. Complex Quantities with k Components. The real and complex 
quantities of ordinary algebra shall be termed scalars in distinction to the 
higher complex quantities, (ai, a?, • • •, a*), which are aggregates of k scalars 
— the components of the complex quantity — taken in a definite order. Such 
complex quantities will be denoted by Greek letters. That complex quantity 
whose components are all zero shall be denoted by 0. Two complex 
quantities, 

a = (ai, 02, • • • , ttk), /3 = (bi, &2, • • • , bk), 

are said to be equal when and only when a, = 6, (i = 1, 2, • • •, ^). We 
define the sum of a and by 

a + (3 s (oi + 6i, 02 + 62, • • • , a* + &*) ; 

and the product of a by a scalar, p, by 

pa s ap = (poi, PO2, • • • , puk). 

* Rendiconti del Circolo Matematico di Palermo, vol. 25 (1908), pp. 66-77. 
t Einfuhrung in die Detenninantentheorie (Veit: Leipzig, 1909), pp. 407-455. 
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The n complex quantities, ai, at, , a„ are said to be linearly dependent 

if there exist n scalars, Ci, C2, • • • , c„, not all zero, such that 

In view of the definition of the complex quantity this is equivalent to 
saying that ai, a%, ••-,«„ are linearly dependent when and only when the 
n sets of k scalars each forming their components are linearly dependent. 
Any A; + 1 complex quantities having k components are therefore linearly 
dependent.* When less than k complex quantities are given, there are 
always others linearly independent of them. 

We also consider the inner product, or simply product, of two complex 
quantities a and |3, defined to be the scalar 

a)3 = aifei + o^ba + • • • + a*b*- 

We note that a^ may vanish when a =|= 0, ;3 =f= 0. From this definition 
it is clear that the commutative and distributive laws, 

a& = (3a, a:(/3 + 7) = a/3 + ay, 

and the associative law in the case of multiplication by a scalar p, 

p{a0) = (?>a)/3 = a(p/3), 

all hold good. The associative law, in the case of the product of three or 
more complex quantities, is not true. Thus a^y is meaningless unless 
either (ai3)7 or a(|S7) is specified. 

A dash above a scalar shall denote, as usual, its conjugate imaginary 
scalar; and we shall extend this notation by writing 

a = (5i, 02, • • •, at). 
Then _ 

a/3 = aiS. 

By the norm of the complex quantity a is understood the scalar 
norm a = aa = Oiai + 0205 + • • • + ««:«* = | Oi 1^ + ! Os |^ + • • • + I Ofc P, 
which is always real. Clearly norm a = norm a. Norm a is when 
and only when a = 0, and is otherwise positive. 

2. Homogeneous Linear Algebraic Equations. Consider now a system 
of n homogeneous equations in k unknowns 

auXi + O12X2 + • • • + auXfc = 

O21X1 + 0223^2 + • • • + <h}iXk = 



. Ofcia"! + a*2a;2 + • • • + dki^k = 0. 



' See, for example, Bdcher's Higher Algebra, § 13. 
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We may regard the coefficients of each of these equations as the components 
of a complex quantity: 

Ui — (an, a a, • ■ •, aik) {i = 1, 2, • • •, n), 

and also the a;'s as the components of the complex quantity 

i = (Xi, X2, ■ ••, Xk). 

Our system of equations may then be written 

(1) ai^ = 0,a2^ = 0, ••■,a„^ = 0. 

Theorem 1. If ^ satisfies equations (1) and is linearly dependent upon 
cci, 0.2, • ■ • , a„, then 1 = 0. 
For suppose that 

I = CiSi + 02a2 + • • • + CnOin. 

Then multiplying equations (1) by Ci, c^, • • • , c„ respectively and adding we 
get 

(Ciai + C2a2 + • • • + c„a„)^ = "^^ = 0. 

Hence ^ = 0, as was to be proved. 

Corollary. If $ satisfies the equations 

5il = 0, 5,i = 0, •••,5„t = 

and is linearly dependent upon ai, a-i, ■ ■ • , ««, then | = 0. 

We are now in position to obtain a criterion for the linear dependence of 
n complex quantities. If ai, a^, ••-,«„ are linearly dependent, 

Ciai + (hOt.2 + • • • + CnOLr,. = 0, 

where not all the c's are zero. Multiplying this relation in succession by 
ai, "2, • • • , 5n, we obtain the n equations 

Ciaittj + Oia-ipn + • • • + CnanOCi = (z = 1, 2, • • •, n). 

In this system of homogeneous, hnear equations in Ci, (h, • • • , c„ the c's are 
not all zero and hence the determinant of the system must vanish. We 
call this determinant, which it should be noticed is a real scalar, the Gramian 
of ai, ai, • • •, a„ and denote it by G (ai, a^, • • ■, a„). Thus 



(2) G{ai, ai, • • •, «„) = 



«i«i aiai • • • aittn 
Oiioci aiUo • • • aiOin 



«„«! a„a:2 • • • 0Cna„ 
The relation G = is therefore a necessary condition for Unear dependence. 
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It is also sufficient. For suppose that G = 0; then the n sets of scalars 
forming the rows of the Gramian are Unearly dependent, and we have 

a,(ci ai+ (ha2 + • • • + c„an) =0 (i = 1, 2, • • •, to), 

where not all of the c's vanish. We now infer from the Corollary of Theorem 
1 that 

Ciai + C2a2 + • • • + Cnan = 0, 

which establishes the linear dependence of ai, ai, ■ ■ ■, an. We have thus 

proved 

Theorem 2. A necessary and sufficient condition that the complex 

quantities ai, a^, • • •, a„ be linearly dependent is that their Gramian vanish* 

We turn now to the solution of the system (1), assuming that these 

equations are Unearly independent, so that G {ai, at, • • • , a„) 4= 0. Every 

complex quantity, and therefore every solution ^i of (1), can be written in 

the form 

(3) $1 = CiSi + c^si-i. + • • • + c„5„ + ^ 

where i? is some complex quantity. In order that this be a solution of (1), 
the scalars Ci must satisfy the n relations 



' C\a\ai + C%avai + • • • + C„a:ia„ = 



(4) 



a\r\ 



, Cia„ai + C'tarS^t + • • • + c^a^n — — Oni- 
Solving these equations for the c's and substituting in (3), we have 

avOLx a-^i • • • aian airi 



(5) 



$1 = 




Every solution of (1) can therefore be expressed in this form. That, con- 
versely, no matter what the complex quantity rj may be, the expression (5) 
always gives a solution of (1) is seen at once by direct substitution; for 
if we form the product a.fi by multiplsdng the last row of the determinant 
in the numerator by a,, this row becomes identical with the ith row. 

* We note in passing that ai, az, •••,a„ are connected by the same linear relation that connects 
■^he rows of their Gramian, written as above. 
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Theorem 3. If the equations 

ai^ = 0, a2| = 0, • • • , a„^ = 0, 

are linearly independent, their general solution is given by (5), where rj is an 
arbitrary complex quantity. 

When $1 vanishes, we see from (3) that rj is linearly dependent upon ai, 
"2, • • • , a„. Conversely, if ^ is linearly dependent upon ai, dci, • • • , 5n, the 
same is true of ^i, and hence, by Theorem 1, ?i = 0. Now to two ^'s 
correspond two |i's whose difference is precisely that solution of (1) which 
corresponds to the difference between the rj's. Consequently two different 
^'s yield the same ^i when and only when their difference is linearly de- 
pendent upon 5l, 012, • • • , OLn. 

If n > A' the equations (1) are necessarily linearly dependent, so that 
Theorem 3 does not apply to this case, li n = k every rj is linearly de- 
pendent on the a's, so that in this case, as is well known, equations (1) have 
only the trivial solution zero. If « < A; we can find k — n complex quan- 
tities oin+i, oin-f.2, • • • , Oik such that «!, oii, • • • , Oik are linearly independent. 
Then every t? may be written as dai + dai + • • • 4- Ckock; but as a change 
in 77 by a quantity hnearly dependent upon Si, 02, • • •, a„ does not affect 
formula (5), we lose nothing in generality if we assume rj of the form 

rj = Cn+l(Xn+l +•••-!- Ck(Xk' 

Thus the solution (5) contains, as it should, k — n arbitrary scalars, C„+i, 
• ■ ■, Ck, and contains them linearly and homogeneously. 
A formula for the norm of |i is readily found. From (3) : 

(6) norm ?i = Ciai^i -!-•••+ c„a„^i + 77^1 = 77^1. 

If we form the product rj^i from (5) by multiplying the last row of the deter- 
minant in the numerator by 77, it is clear that 

(7) norm a = -797 — x— . 

We proceed to use this relation to establish an important property of 
Gramians. In (7) ai, 0:2, • • •, ««, v may be regarded as n+1 arbitrary com- 
plex quantities; we will assume that they are linearly independent. Then 
rj is clearly not a Unear combination of ai, ao, • • •, ««, so that |i + and 
norm ^ > 0. Moreover this assumption entails that none of an, 0:2, • • • , 
an, V vanish, and hence the Gramian of any one, e. g., G (ai) = aiai, is real 
and positive. Hence by giving to n in (7) in succession the values 1, 2, • • •, 
we establish by mathematical induction 

Theorem 4. The Gramian of any number of linearly independent complex 
quantities is real and positive. 
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3. Non-Homogeneous Linear Algebraic Equations. We come now to 
the system of non-homogeneous equations 

(8) ai^ = 6i, aj^ = &2, • • •, an^ = hn, 

where we again assume that ai, ai, • • • , a„ are Unearly independent, and 
try to find a solution of the form 

(9) ^0 = ciSi 4- (hoii + • ■ • + c„5„. 

Substituting this in (8), we obtain n linear equations, which may be obtained 
from equations (4) by replacing their right hand members by 6i, 62, ••-,?)„ 
respectively. These can, as above, be solved for the c's by Cramer's rule, 
and the results substituted in (9). This gives 

• • • ai5„ — 61 



(10) 



?o = 




G{a\, Ui, • ■ ■, an) 

That this is really a solution of (8) we see by direct substitution. For if 

we form the product a,|o, the last row of the determinant in the numerator 

becomes 

aiai, aiao, • • •, aia„, 0; 

and, when the ith row is subtracted from this, it appears that 

a.-^o = biG/G = bi. 
We have thus proved 

Theoeem 5. // ai, a2, • • • , a„ are linearly independent, the equations 
(8) }Mve one and only one solution of the form (9), and this is given by (10). 

The general solution of (8) is of course obtained by adding to the par- 
ticular solution (10) the general solution (5) of the homogeneous equations 
(1) ; it is therefore 



(11) 



? = ^0 + ^1 = 



anai a„o;2 

Oil «2 



anOn CCnV — fen 



G{ai, a2, • • •, an) 



The solution (10) of (8), which is characterized by being the only solution 
of (8) which is linearly dependent upon the as, shall be called the principal 
solution of (8), It has also another characteristic property which may 
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be deduced as follows. From (11) we see that 

^1 = (^0 + ^i)(io + ii) = loio + ^oii + kil + Sifi; 

and from (9) 

Ml = CiSiii + c^aiki + • • • + c„5„$i = 0, 

remembering that |i is a solution of equations (1). Consequently ^i^o = 0, 

and 

(12) norm | = norm ?o + norm ^i, 

so that 

norm ^ ^ norm $o, 

the equahty sign holding only when |i = 0, in which case ^ = ^o- Thus we 
have 

Theorem 6. Among the solutions of (8) no other has so small a norm 
as the principal solution. 

To obtain a formula for norm ^o we multiply the last row of the deter- 
minant in the numerator of (10) by io and simplify by use of the equations, 
a.lo = bi', thus* 



(13) 



norm ^o = 



aiai o;]«2 



a„ai anai 



ai<x, 



n. bi 



fei 



b„ 



G(ai, aj, • • •, an) 



Norm ^ is now given by (12). 

4. System of a Finite Number of Linear Equations in an Infinite Num- 
ber of Variables. We now consider a system of n equations 



(14) 



aaXi + a, 2X2 + 



= 



(i = 1, 2, •••, n), 



where the number of unknowns Xi, xi, • • • is infinite. For this purpose we 
use complex quantities with an infinite number of components. If a = 
(oi, 02, • • •) is such a complex quantity, we consider the series | ai |^ + | Oj | 
+ • • • . If this series is convergent, we say that the complex quantity 
has a finite norm and define 



norm a = | at p + j 02 j^ + 



) I 



! a I s i/norm a. 



* If not all of the b's vanish, it is clear from equations (8) that & + 0, and hence norm Jo > 0. 
By means of (13) we may now prove at once the following 

Theorem. // Ike Gramian of linearly independent complex quanliiiea is bordered by scalars that 
do not all vanish so as to form a determinant of the type of that in (13), this bordered Gramian is 
negative. 
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The sum of a = (ai, (h, ■ ■ ■) and /3 = (61, h^, ■ ■ ■), and the product of a 
by a scalar p are defined as 

a + /3 s (ai + bi, 02 + &2, • • •), pas ap s {pai, pa^, ■ ■ ■). 

The product a^ we define by the formula 

a/S = O161 + 0262 + • • • 

whenever this series converges. When a and ^3 have finite norms their 
product ajS always exists, as then the series in question is absolutely con- 
vergent. For writing 

tti = (jail, losl, • • •, \ak\), /3i = (|6il, Ibzl, • • •, \hk\) 

we have from Theorems 2 and 4 



aicak akh ! 

^ka,: Pk^k i 



G{ak, &k) 

Hence, as at = a.k and ^k = ^i, 

(ttift)^ ^ norm a • norm /3 
or 

laA!+ ••• + laA-l ^ i«!|/3i. 

Since this holds for all values of k, the absolute convergence of our series 
is estabUshed. 

The distributive law, a(/3 + 7) - a^ + ay, evidently holds when ajS and 
0:7 have meanings. Thus, in particular, if a and ^ have finite norms, we 
have 

norm (a + |8) = (« + ^){a + ^) = a5 + ^S + a^ + /3^, 

so that if two complex quantities have finite norms their sum also has a 
finite norm. It is also obviously true that if a complex quantity has a 
finite norm it will still have a finite norm after being multipUed by a scalar. 
From these two facts we readily infer that if a number of complex quantities 
have finite norms any complex quantity Hnearly dependent upon them also 
has a finite norm. 

Using the n + 1 complex quantities 

a,- = icLa, aa, ■ • ■) (i = 1, 2, • • •, n), 

k = {xi,Xi, ■••), 

the equations (14) may be written 

(15) ai$ = 0, a^i = 0, •••, a„? = 0. 

We place upon the coefficients ai the restriction that they have finite norms. 
Then | is to be so determined that the series ati all converge to the value 
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zero. If I has a finite norm the series «,$ necessarily converge, but this 
may also be the case when ^ has an infinite norm. 

Theorem 7. If ^ satisfies the equations (15) and is linearly dependent 
on 5], 0(2, • ■ -, an, then ^ = 0. 

The proof is exactly that of Theorem 1. We shall define the Gramian 
of a set of complex quantities of finite norm precisely as was done in § 2. 

Theorem 8. A necessary and sufficient condition that n complex quantities 
of finite norm be linearly dependent is that their Gramian vanish. 

The proof is precisely that of Theorem 2. 

Theorem 9. // equations (15) are linearly independent, their general solu- 
tion is given by formula (5), where rj is any complex quantity such that the 
products ai^, a27J, • • -, anV all exist. 

The proof is practically identical with that of Theorem 3. In order that 
the solution |i have a finite norm it is necessary and sufficient, as we see 
from (3; , that 17 have a finite norm. 

Here, as in § 2, it is clear that two ^'s lead to the same solution $1 when 
and only when their difference is linearly dependent upon 5i, at, • • • , a„. 

The requirement that 77 be so chosen that airi, a^ri, • • • , Unrj all exist 
will be fulfilled when rj has a finite norm. It will, however, be fulfilled in 
many other cases. For example, denoting the components of a, by an, 
a 12, • • -, if all the Oi/s are positive and a,j constantly decreases and ap- 
proaches zero with increasing j, we may take for 17 the complex quantity 
(+1, — 1, + 1, — 1, • • •) whose norm is infinite. 

Whenever |i has a finite norm, i. e., whenever this is true of tj, its norm 
is given by formula (7). As in §2 this formula may be now used to establish 

Theorem 10. The Gramian of any number of linearly independent com- 
plex quantities of finite norm is real and positive. 

We now pass to the non-homogeneous equations : 

(16) ai^ = 61, Ui^ = &2, • • • , ttn^ = b„, 

the coefficients a, again being assumed to have finite norms. 

Theorem 11. If ai, a2, • ■ • , an are linearly independent, the equations 
(16) have one and only one solutionjinearly dependent upon a\, 02, • • •, a„, and 
this solution is given hy formula (10). 

The proof is precisely that of Theorem 5. The solution in question is 
termed the principal solution. The general solution of (16) is given by 
formula (11), where 5} is any complex quantity whose products with ai, 
a2, • ■ •, an exist. 

Theorem 12. Among the solutions of (16) no other has so small a norm 
as the principal solution. 

The principal solution, being a linear combination of ai, az, • • • , an, 
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has a finite norm. This is also true of the general solution, | = |o + ^i, 
when and only when ^i has a finite norm. From here on the proof is just 
like that of Theorem 6. 

The norm of |o is given by formula (13).* 

5. Some Theorems on the Limits of Complex Quantities. We proceed 
to estabUsh some properties, which will be important for us, of complex 
quantities with an infinite number of components.! 

If a and /3 have finite norms, we have from Theorems 8 and 10 



G(a, /3) = 



aa a/3 

^5 l& 



= la|2!/3i2-|ai3|2^0, 

whence 

(17) \a&\^\a\\&\. 

Again, if 7 = a + /3, we have, using (17) and remembering that 

I 7 |'= (a + /3) (5 + ^) = a5 + a/3 + ^5 + ^^ ^ I a j2 + 2 I a I I ^ ! + I /3 |2, 

(18) I 7 I ^ I « I + I ^ i- 

We next lay down the following 

Definitions. 7/ a„ = (a„i, a„2, •••))« = («i» <h., ■ ■ ■), we say that a„ 
converges to a as n becomes infinite when 

lira ttni = a.- {i = !> 2, • • •), 

and write 

lim a„ = a. 

We say that an has strong convergence toward a when, for all values of n 
greater than a certain number, a — an has a finite norm, and 

lim 1 a — a„ I = 0, 

and write, using Schmidt's notation, 

lim an = a. 

Strong convergence implies convergence. For if lim„=. | a — a„ | = 0, 
there exists, for every positive e, an integer N such that 

(19) Sla.-a„i|=< eS n>N, 



* The theorem regardiBg bordered Gramians, stated in the footnote to formula (13), may 
now be generalized so as to apply to the Gramians of complex quantities with finite norms, 
t Due to E. Schmidt, 1. c, §§ 1-4. See also Kowalewski, 1. c, § 165. 
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SO that 

(20) |a,-a„,|<*, f'^nViV,"''' 
or 

lima„.- = a. {i = 1, 2, •••)•* 

If linin-, an = a and a„ has a finite norm when n is greater than a certain 
number, then a will have a finite norm. For (19) states that when n > N, 
a — an has a finite norm; consequently the sum of a„ and a — an has a 
finite norm. 

Again, if lim„^„a„ = a, lim„=./3„ = )3, then 

(21) lim(a„ + /3„) = a + ;3; 

for we have seen that when n> N,a — an and & — ^n have finite norms, and 
hence from (18) we have 

I a + /3 - a„ - ^„ 1 ^ I a - a„ I + ! /3 - ^„ 1. 

Furthermore if a„, ^n have finite norms when n > AT, so that a, have finite 
norms, 

(22) hm anfin = a0; 

for when n > AT, we have, using (17) and (18), 

I al3 - a„/3„ | = | (a - a„)/3 + (/3 - /3„)a - (a - a„)(|3 - /3„) ! 

^|a-a„||/3| + l|3-/3„||a|+la-a„||^-/3„l. 
Important special cases of (22) are 

(23) lim an^ = a/3; 

(24) lim norm a„ = norm a. 

Theorem 13. A necessary and sufficient condition that Km„=„ a„ exist is 
that, when n and m are any integers greater than a certain number, an — am 
have a finite norm, and that to every positive « there correspond an integer N 
such that 

(25) I a„ — «„ I < «, m,n> N. 

The condition is necessary; for if Iimn=, an = a, | a — a„ j < ie when 
n > N. Hence when m, n > N 

* We say that o„ converges uniformly toward a when for every positive « there exists an N 
such that (20) is true. It is clear from the above that strong convergence implies uniform con- 
vergence, and uniform convergence implies convergence; but these implications do not hold in the 
reverse order. 
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I an — am I = I On — a + a — ttm I ^ 1 an — a 1 + I a — ttm I < «• 

To show the sufficiency of the condition we first observe that if (25) 
holds, 

Jl\ank-a„k\- < e^ m,n> N, 

and hence 

U n \^ lik = 1,2, ■■.),] 

This shows that lim„=„a„i exists; denote it by o*. Then as 

p 
22 ! a„fc - a^k P < f% m,n> N, 



p 



lim ]C i Onfc - amk\- = 5Z I fli — amk !^ ^ «-, m> N. 

As this holds for every p, we have 

S 1 at - amk 1^ ^ e", m > A' ; 

or, upon writing a = (ci, On, • ■ •), 

lim I a — am j =0 

as we wished to prove. 

Corollary. When condition (25) is fulfilled and an is always of finite 
norm, a is also of finite norm. 

Definition. The infinite series of complex quantities ai + 02 + • • • is 
said to converge strongly to a complex quantity <r when <r„ converges strongly to 
<r, where <r„ = ai + • • • + a„. 

From Theorem 13 we see that a necessary and sufficient condition for 
the strong convergence of the above series is that after a certain point the 
terms of the series all have finite norms and that, to every positive e, there 
correspond an integer N such that 

(26) 1 o-„ — <r„ 1 = 1 am+i + am+2 + • • • + a„ [ < e, m, n > N. 

Definition. Two complex quantities a, 13, are said to be orthogonal if 
a^, and hence also aj3, is zero. 

If the a's have finite norms and are mutually orthogonal, we may, by 
squaring (26), readily reduce it to the form 

! am+i P + 1 am+2 1^ + • • • + I an 1^ < €^ m, n > N. 

This being precisely a necessary and sufficient condition that the series 
j ai 1^ + I a2 j^ + • • • converge, we have proved 

Theorem 14. A series of mutually orthogonal complex quantities of 
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finite norm is strongly convergent when and only when the series of their norms 
converges.* 

Furthermore as | (r„ |^ = 1 ai |^ + | aa i" + • • • + 1 "n l^ we infer from (24) 
the 

Corollary. If the conditions of Theorem 14 are fulfilled, the norm of the 
series is equal to the series of the norms of the terms. 

6. System of an Infinite Number of Linear Equations in an Infinite 
Number of Variables. We are now in position to consider the infinite sys- 
tem of homogeneous equations in an infinite number of variables 

(27) ail = 0, asl = 0, •••, 

where 

oii = (an, aa, • • •) (i = 1, 2, • • •), 

I = {Xi, X2, • • •). 

We assume that all the coefficients ai have finite norms and none of them 
are linearly dependent. The general solution, ^^\ of the first n of these 
equations is given by formula (5) 



«„«! a„a;2 



«! Oii 



«!«„ 


din 


OinOin 


Oinn 


Oln 


n 



Here (ci^"^ C2^"\ • • •, c„'"^) is a solution of equations (4). 

We wish to show that |i^"> converges strongly to a limit as n = » ; 
and to this end we proceed to throw it into the form 

li<"> = |i<» + (Ii(^> - f/») + • • • + (li<"' - |i'"-»). 
If we write 

c.(n) _ c.(»-i) = gX") (i = 1, 2, • • •, n - 1), 

^ (n) ^ - (n) 

and subtract from the first n — 1 equations (4) the similar equations satisfied 
by (c/"~'>, • • •, C;v_i^"~^'), we find that the s's satisfy the n — 1 homogeneous 
equations 

aiai2:i<"' + a;ia2S2'"' + • • • + aia„3„<"> = 



an-iaiZi'") + a:„_ia232^"^ + • • • + a„-ia„Z,/"> = 0. 



* The proof above establishes the more general theorem in which the condition of orthogo- 
nahty is replaced by the condition aiS,- + «,«{ = or (real part of «< a/) = when i 4-y, i,j = 1, 
2, .... 
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Moreover we have 

tj(n) _ l^(n-l) = 2i("'5i + Z2^->a2 + • • • + 2n^">5„ (n = 2, 3, • • •)• 

Solving the homogeneous equations for the z's and substituting in the last 
equation, we have 

(29) $l(") - ^/"-D = kn<Pn, 

where kn is an undetermined scalar and 



<Pn = 



aiai 



oiiai 



a„-iai an~i(X2 



<xi 



Oil 



aia„ 



O-n-XOi-n 
OLn 



(^ = 2,3, •••). 



Multiplying both sides of (29) by «„ and using (28), we find - HnlGn~i 
= knGn, where, for brevity, we have written 



i?n = 



ociai 


aiai 


«!«„_! 


ai? 






ttn-iai 


a„_ia2 • 


• * 

• • a„_ia„_i 


an-lT) 


(n=2, 3, • 


••). 


UnOii 


OinOti 


a„a„_i 


Oi^n 






G(ar, . . 


■, ««). 










|^(n> .. 


_ ^/n-l) = 











Therefore 



and as |i<" = i? — (aiJj/aiSOai, we have, if we set <pi = ax, Go = 1, Hi= aitj, 



(30) 



^,(») = i - 2: 



Hr, 



>i=J "n— l(rn 



Vn. 



If 77, and hence ^/""^ has a finite norm, we see from (6) that norm $/"•> 
= tjIi'*"'. Assuming, then, that this is the case, we have, since <pnri = Hn, 

(31) norm li^") = I tj |^ - Z ^^ . 

The series of positive or zero terms 



(32) 



V' I ■"" I 



is therefore convergent for everj' 77 of finite norm since the sum of its first 
m terms is by (31) not greater than | rj |^ 

We next note that the terms of the series of complex quantities of finite 
norm 
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(33) 5Z 7^~ln ^n 

n=l Wr— iWn 

are mutually orthogonal; for as 

fnoii = (i = 1, 2, •••,n - 1), 

we have 

«9„^m = 0, m <n. 

By Theorem (14) the series (33) will converge strongly if the series of the 
norms of its terms converges. If we use the relation 

this series of norms proves to be precisely (32), which we have just shown 
to be convergent when -n is of finite norm. Hence series (33) converges 
strongly when ij has a finite norm, as does likewise the series 

(34) ii s lim ^Z") =n -11 r r' *'- = 'J " 2 t-^ <?«. 

li is a solution of equations (27) having a finite norm. For consider any 
one of these equations, say at^ = 0; since 

a^t^i""^ =0 (m = A;, A; + 1, •••), 

Tve have from (23) 

lim (a^fc^i*"*)) = afc^i = 0. 

That |i is of finite norm follows from the fact that ^i^"*' is always of finite 
norm and converges strongly towards ^i. 

Conversely, if $i is any solution of equations (27), we may obtain it by 
letting ^ = ^1 in the formula (34), for then all the terms after the first 
vanish. Thus we have proved 

Theorem 15. If i? is a complex quantity of finite norm, $1^"^ given by 
formula (28), approaches a limiting complex quantity of finite norm as n 
becomes infinite, and this limit, ^i, is a solution of the equations (27) . 

Conversely, every solution of (27), whether of finite norm or not, can be 
obtained by properly choosing rj in (34). 

From formulas (24) and (31) we have 

(35) norm ^i = lim norm |i<"' = \v\^ — 11 rr 

whenever r; is of finite norm. Referring to (7), we see that this may also be 
written as 

/o«^ ^^r^ t w^ (?(»!, «2, •• •, an, n) 

(36) norm §i = lim —j=r, r— • 

n=« G(ai, ai, • • •, «„) 
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We turn now to the non-homogeneous equations 
(37) ai? = 61, a2^ = 62, • • • , 

where we again assume that all the coefficients a, have finite norms and 
none of them are hnearly dependent. The principal solution of the first 
n of these equations, which we will denote by ^0^"', is given by formula (10) 



(38) 



y"'= Zc/"'^.- = 






«„«« —b„ 




a„ 



G{ai, ai, • • -, a„) 



Here (ci<"^ C2'"\ • • •, c„<"') is a solution of the equations obtained from (4) 
by replacing their right-hand members, — airj, — airj, • • • > — ««'? by 
fei, hi, • ■ -jbn respectively. A consideration of the process by which $i<"^ — 
^/"-i' was obtained shows that we may obtain $0^"' — ^o^""" from this ex- 
pression by replacing — avn, — a->Jf\, • • •, — a,^ \>y bi, bj, • • •, bn respectively; 
consequently in place of — H„ we must now introduce the determinant 

aitti cviSs • • • aioin-i bi 

Oi2(Xi OLiai • • • > a20ln—i Oo 



Bi = h, 5„s 



and we obtain 

As 



a„ai a„a2 



a„an- 



-1 fcn 



(n=2, 3, •■•) 



Sn 



(39) 



n = l vTn— lun 



We are thus led to consider the series 



(40) 



to D 



whose terms are mutually orthogonal complex quantities of finite norm — 
as we know from the previously estabUshed properties of ^„. By Theorem 
14 this series will be strongly convergent when and only when the series of 
the norms of its terms 
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(41) 






E i2 



converges. Thus when series (41) converges we have 



(42) 



$0 = lim foC") = S 



Bn 



»=1 Gn-lG, 



<Pn 



and an argument similar to that which follows (34) shows that |o is a 
solution of equations (37) having a finite norm. Now if equations (37) 
have any solution, $, of finite norm, then, as ^o'"' is the solution of least 
norm of the first m of these equations, 

norm ^o*"*' ^ norm |; 

and since norm ^o'""' proves to be precisely the sum of the first m terms of 
(41), the convergence of this series is estabUshed. Thus we have proved 

Theorem 16. A necessary and sufficient condition that equations (37) 
have a solution of finite norm is that the series (41) converge. When this is 
the case, lo*-"', given by formula (38), approaches strongly a limiting complex 
quantity of finite norm as n becomes infinite, and this limit, ^o, is a solution of 
the equations. 

^0 is termed the principal solution of (37). We may form the general 
solution by adding to the particular solution |o the general solution $i of 
equations (27): 



(43) ^ = ^0 + ?i = lim 



aiai aiaz 



aia„ airj — 6i 



a„ai a„a2 



ai ao 



a„an OinV 



(Xn 



-6„ 



G{ai, a2, • • • , a„) 
From the Corollary to Theorem 14 we have 

norm |o = 2- "? 
or, referring to (13), 



(44) 



norm fo = lim — 



«l5l aiOii ■ ■ • aittn bi 



a„ai a„a2 
bi b. 



anCtn bn 
In 



G{ai, ai, • • • , a„) 
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If $1 has a finite norm, the same is true of ^, and 

norm | = norm ^o + norm $i, 

for from (38) ^o<"'fi = 0, so that upon applying (23), ^oFi = ^ilo = 0. Con- 
sequently 

norm ^ ^ norm ^o 

the sign of equahty holding only when |i = 0, in which case | = ^o- Thus 
we have proved 

Theorem 17. Among the solutions of (37) no other has so small a norm 
as the principal solution. 

7. Some further facts. — The general solution fi of the homogeneous 
equations (27) is a function of the complex parameter r] 

ki = Hv). 

A glance at (28) shows us at once that yp is, in an extended sense, a 
linear function ; that is 

Theorem 18. If i\ , rj", • ■ •, 77'*^ are complex quantities with finite norms 
and Ci, ■ • -, Ck are scalars, then 

HcW + • ■ • + Ca7,[") = c^^|yW) + • • • + CkHrj^"^)- 

A further important fact is that \{/ has strong continuity for every value 

of V with finite norm; that is 

Theorem 19. If rj' has a finite norm, then as 7? approaches rj' strongly, 

\}/{ri) approaches ^W) strongly. 

To prove this, we derive from Theorem 18 and from (35) the relation 

norm [i/W) — ^{r))] = norm ^(7;' — v) S norm (?;' — 77), 

from which our theorem follows at once. 

Let us now denote the components of 7? by 2/1, 2/2, • • • • , and the com- 
plex quantity whose first n components are j/i, ■ ■ ■, Vn while all its sub- 
sequent components are zero bj^ rjn- Then, if -q is of finite norm, 

(45) lim Tin = 7?. 

For norm (7? — 7?„) = \yn+i\^ + lynWi'^ + , and, this being the remainder 

of a convergent series, approaches zero as n becomes infinite. 

Let us denote by e, the complex quantity whose ith. component is 1 
while all its other components are zero. Then 



a„ai • • ■ a„an dni 
Oil ■ • • oin a 



V^(*.)=^ (?(«„ ...,a„). 
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Theorem 20. A necessary and sufficient condition that the homogeneous 
system (27) have no solution of finite norm except zero is that all the quantities 
\piei) be zero. 

That this is a necessary condition is obvious. To prove it suJ0ficient 
assume x{/{ei) =0 {i = 1, 2, ■ • ■). By Theorem 18, \p(7]) = whenever r) 
has only a finite number of components different from zero. But, by (45), 
every rj of finite norm is the strong limit of such a set of 77's. Consequently, 
by Theorem 19, 4'(.v) = for every 77 of finite norm, as was to be proved. 

We have expressed the solutions ^1 and ^0 as well as their norms, as the 
limit of the ratio of two determinants of order n + I and n as n becomes 
infinite. We proceed to inquire under what conditions the individual 
determinants, and not merely their ratios, converge. In all cases the 
denominator determinant is G{ai, • • •, a„), and if this Gramian converges 
as n becomes infinite, the determinants in the numerators will likewise pon- 
verge. Thus we have merely to consider the convergence of G(ai, • • • , a„) 
as n becomes infinite, or, as we phrase it, the convergence of the infinite 
Gramian, G{ai, aa, • • •)• 

Theorem 21. A sufficient condition for the convergence of the infinite 
Gramian of the complex quantities ai, 0:2, • • • which have finite norms is that 
the infinite product 11^=1 i «i 1^ diverge to zero or converge. 

Consider the set of complex quantities /3f = a:,/|a,| whose norms are 
all unity. We have, then, 



(46) 
Now 



G{< 



«i, 



an) = G(/3i, 



/3n)n 



a; 



G(ft, •••, /3„) = 



/3i/3i 



/3i/3„-i ;8i/3„ 



Ml ••• Mn-l 



+ l^npG(ft, ..•,/3„_0. 



The first term on the right is a bordered Gramian of the form of the numer- 
ator of (13) and is therefore negative or zero (see footnote at the end of § 3). 
Consequently 

G(i3x, ...,/3„) ^G(/3i, •••,^n_i); 

and since G(^i, • • •, )3„) is never negative, Um„=„ G(/3i, • • •, |8„) exists. Thus 
when 117=1 I «iP diverges to zero or converges, we have from (46) that 
G{ai, 0:2, • • •) converges, as we wished to prove. 

Corollary 1. If G(/3i, ft, • • •) +0 the condition that nr=i i «• I* diverge 
to zero or converge is also necessary for the convergence of G{ai, a^, • • •). 
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Corollary 2. If II*'=i 1 «.- 1^ = 0, then G{ai, a^, • • ■) =0. 

We also note that G(a:i, a^, • • ■) = Q when any of the complex quantities 
ai are linearly dependent. 

From Theorem 21 we now see that the determinants occurring in the 
expressions for ^/"' and ^o^"' (and for their norms) will converge as n = « if, 
at the start, the equations (27) and (37) respectively are divided through 
by scalars so as to make the norms of all the a's ^ 1. If, when this is 
done, <?(«!, ai, • • •) +0, the formulae for ^i and ^o furnish solutions for 
these infinite systems of equations in terms of infinite determinants, properly 
so called. Of course the last row and column of the numerator determinants 
must then be written as first row and column. 

Cambridge, Mass. and Cincinnati, Ohio, 
December, 1911. 



